Binary Space Partitioning as Intrinsic Reward
نویسنده
چکیده
An autonomous agent embodied in a humanoid robot, in order to learn from the overwhelming flow of raw and noisy sensory, has to effectively reduce the high spatial-temporal data dimensionality. In this paper we propose a novel method of unsupervised feature extraction and selection with binary space partitioning, followed by a computation of information gain that is interpreted as intrinsic reward, then applied as immediate-reward signal for the reinforcement-learning. The space partitioning is executed by tiny codelets running on a simulated Turing Machine. The features are represented by concept nodes arranged in a hierarchy, in which those of a lower level become the input vectors of a higher level.
منابع مشابه
Which Space Partitioning Tree to Use for Search - Summary
Trees like binary-space-partitioning trees, kd-trees, principal axis trees and random projection trees are used to answer the question ”which tree to use for nearest-neighbor search?.” This paper deals with the influence of the vector quantization performance of the trees on the search performance and the margins of the partitions in these trees. Theoretical results show that both factors have ...
متن کاملReinforcement Learning Trees
Two new reinforcement learning algorithms are presented. Both use a binary tree to store simple local models in the leaf nodes and coarser global models towards the root. It is demonstrated that a meaningful partitioning into local models can only be accomplished in a fused space consisting of both input and output. The rst algorithm uses a batch like statistic procedure to estimate the reward ...
متن کاملAnalysis of Markov Renewal Reward Process on VLSI Cell Partitioning
It is well known that various characteristics in risk and queuing process can be formulated as Markov Renewal function. We study the max-position of finitely many Markov Renewal Reward process with countable state space. We define Markov Renewal equation associated with max-posed process. The solutions of the Markov Renewal Reward equation are derived and the asymptotic behaviors of the equatio...
متن کاملMulti-class Classification: A Coding Based Space Partitioning
In this work we address the problem of multi-class classification in machine learning. In particular, we consider the coding approach which converts a multi-class problem to several binary classification problems by mapping the binary labeled space into several partitioned binary labeled spaces through binary channel codes. By modeling this learning problem as a communication channel, these cod...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012